Hdf 5 – a High Performance Data Format for Earth Science
نویسندگان
چکیده
HDF is a set of data formats and software libraries for storing scientific data with an emphasis on standards, storage and I/O efficiency. HDF software is open-source and free. HDF4 is based on the original 1988 version of HDF and is backwardly compatible with all earlier versions. HDF4 file size cannot be greater than 2GB and the number of objects inside an HDF4 file must be less than 20,000. The data model of HDF4 is rigid and HDF4 does not support parallel I/O. HDF5 is a new data format and it was first released in 1998. HDF5 limits neither the size of files nor the size or number of objects in a file. HDF5 is based on a more general data model and emphasizes standards and flexible, efficient IO.
منابع مشابه
Design and Implementation of Gateau API for HDF-EOS
n late years the visualization technol gy is used extensively in various research fields, and plays an impo ant role in a mosph ric science research. Gateau, which we have been developing, is a system that helps atmosph ric scientists analyze data by visualizing earth ob servation data used in atmosph ric science research. In this investigation, we have selected HDF-EOS as a data format for Gat...
متن کاملMerging the NetCDF and HDF5 Libraries to Achieve Gains in Performance and Interoperability
This proposal seeks to advance the technology available for accessing scientific data and for integrating observations with model representations in multiple disciplines by extending and merging the Network Common Data Form (netCDF [8]) library and the Hierarchical Data Format-5 (HDF5 [10]) library. These two independently developed data-access libraries and formats provide simple, efficient, a...
متن کاملAtmospheric Sciences and Climate Applications Using Hdf and Hdf5
Since 1998, NCSA has developed a more general and robust data format, called HDF5, which was designed to support the future demands of Earth Science, such as large data storage, performance, and flexibility. The NCSA HDF group encourages applications to use HDF5 for better performance and maintenance. See extend abstract P2.42 for more information about HDF5. In summary, HDF5 has the following ...
متن کاملImplementation of CCSDS Lossless Data Compression in HDF
The Earth Science Data and Information System (ESDIS) handles over one terabyte (10 12 bytes) of data daily and is using the Hierarchical Data Format (HDF) for data archiving and distribution. This report provides the progress and status of our effort to alleviate bandwidth and storage burdens by first performing compression studies on various science data products and later integrating the sel...
متن کاملNasa Standards for Earth Remote Sensing Data
Earth Observing System (EOS) is one of NASA's large programs for Earth science and global change research. In order to process, distribute, and archive data from EOS satellites and to facilitate interdisciplinary research, NASA has developed the EOS Data and Information System (EOSDIS) that defines a set of standards to deal with remote sensing data. In EOSDIS, data are grouped into three conce...
متن کامل